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(57)Abstract 

PROBLEM TO BE SOLVED: To provide an image processing device, 
method and program for extracting the characteristic of a specific 
attribute of an image without depending on subjectivity. 
SOLUTION: A plurality of personal face images are stored. 
Coordinate values of a plurality of characteristic points of each 
stored face image are extracted. An age attribute value of each 
face image is acquired. The shape characteristic vector Fi of each 
face image is configurated by using the coordinate values of the 
plurality of characteristic points and the age attribute value 
acquired for each face image. A characteristic value o1 of a first 
main component is calculated by analyzing the main component on 
the basis of the shape characteristic vector Fi of the plurality of 
face images. A main component characteristic vector Pmax, Pmin of 
the first main component is configurated by using a characteristic 
value a1 of the first main component A face shape vector Fmax, 
Fmin of the first main component is configurated by using the 
characteristic value a1 of the first main component. The face shape 
vector Fmax, Fmin of the first main component is re configurated by 
using the characteristic value a1 of the first main component, and 
the age characteristic vector F representing the age attribute 
characteristic is extracted. The face image of the desired age is 
composed by using the age characteristic vector F. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 
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[Claim(s)] 
[Claim 1] 

An image storage means to memorize two or more images, 

A feature- extraction means to extract two or more gestalt-descriptions of each image memorized by said image 
storage means. 

An attribute acquisition means to acquire the attribute of each different image from the gestalt-de script ion, 
A gestalt feature-vector configuration means to constitute the gestalt feature vector for every image which makes 
a variate the attribute of each image acquired by two or more gestalt-descriptions and said attribute acquisition 
means of each image extracted by said feature-extraction means. 

The image processing system characterized by having a principal-component-analysis means to compute the 1st 
principal component by principal component analysis from the gestalt feature vector of two or more images 
constituted by said gestalt feature-vector configuration means. 
[Claim 2] 

A variability region decision means to determine the variability region of the 1st principal component using the 
characteristic value of the 1st principal component computed by said principal-component-analysis means. 
The image processing system according to claim 1 characterized by having further an attribute feature-vector 
reconstruction means to re configurate the attribute feature vector which shows the description of an attribute, 
using as a variate the variation of two or more of said gestalt-descriptions in the variability region of the 1st 
principal component determined by said variability region decision means. 
[Claim 3] 

The image processing system according to claim 2 characterized by having further an image composition means to 
compound other images with which said attributes differ from a specific image using the attribute feature vector 
obtained by said attribute feature-vector reconstruction means. 
[Claim 4] 

Said image composition means is an image processing system according to claim 3 characterized by compounding 
an image besides the above from the gestalt feature vector which constitutes the gestalt feature vector which 
makes a variate said two or more gestalt-descriptions of said specific image, corrects each variate of the gestalt 
feature vector based on the variate to which said attribute feature vector corresponds, and has the corrected 
variate. 
[Claim 5] 

Said two or more images are two or more face images, 

Said attribute is an image processing system according to claim 1 to 4 characterized by being age, real age, sex, a 
race, an apparent expression, or an apparent bodily shape. 
[Claim 6] 

Said two or more gestalt-descriptions are image processing systems according to claim 1 to 5 characterized by 
including the coordinate value of two or more focus defined beforehand. 
[Claim 7] 

The step which memorizes two or more images. 

The step which extracts two or more gestalt-descriptions of each of said memorized image. 
The step which acquires the attribute of each different image from the gesta It-description, 

The step which constitutes the gestalt feature vector for every image which makes a variate two or more gestalt- 
descriptions of each of said extracted image, and said acquired attribute of each image, 

The image-processing approach characterized by having the step which computes the 1st principal component by 
principal component analysis from the gestalt feature vector of two or more of said constituted images. 
[Claim 8] 

It is the image-processing program in which computer reading is possible. 
Processing which memorizes two or more images. 

Processing which extracts two or more gestalt-descriptions of each of said memorized image. 
Processing which acquires the attribute of each different image from the gesta It-description, 

Processing which constitutes the gestalt feature vector for every image which makes a variate two or more gestalt- 
descriptions of each of said extracted image, and said acquired attribute of each image. 

Processing which computes the 1st principal component by principal component analysis from the gestalt feature 
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vector of two or more of said constituted images. 

The image-processing program characterized by performing said computer. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

This invention relates to the image processing system, the image-processing approach, and image-processing 

program which extract the description of the predetermined attribute of an image. 

[0002] 

[Description of the Prior Art] 

In communication, the face has played the important role. Especially, various information, such as age, a race, sex, 
and expression, can be acquired from a face. Wording and an attitude are often exponentially decided from a 
partners age, and age can be said to be one of the important elements for communication. 
[0003] 

the difference of the average face of the approach of compounding a face image by using the characteristic part of 
the formation of a form status change for the face image composition technique operate age change of a face, as a 
deformation parameter from the frame model of secular change of a face, and a different generation who generated 
based on two or more face images — the approach of compounding a face image using information etc. be propose 
( for example, nonpatent literature 1 and nonpatent literature 2 reference). Since only the limited deformation 
parameter set up artificially is used by the approach using a deformation parameter from the frame model, it cannot 
declare that the description which influences secular change can be operated exactly, the difference of the average 
face of a generation different on the other hand — by the approach using information, in case each generation's 
average face is created, it is necessary to use a sufficient number of original face images the difference extracted 
when the number of original face images was not enough — the difference of the element of the individual 
description which not only an age element but an original face image has may be included in information. 
[0004] 

[Nonpatent literature 1] 

Masamichi Nakagawa, **** Toshihiko, Fumio Maehara, Kunihiro Chihara. and "age change simulation of face 

image using frame model" (IEICE TRANSACTIONS A) V0I.J8O-A, N0.8, pp.1312-131 5, Aug.1997 
[Nonpatent literature 2] 

D.A. Rowland, D.LPerrett, and "Manipulating Facial Appearance through Shape and Color" IEEE Computer Graphics 

and Applications. Vol.15, No.5. pp.70-76, Sep.1995 

[0005] 

[Problem(s) to be Solved by the Invention] 

In recent years, the age feature extraction using principal component analysis (Principal Component Analysis:PCA) 
is tried. PCA is the multivariate-analysis technique which is going to express the multi-dimension space (feature 
vector) constituted by two or more variates (variable) as a feature vector of the smallest possible number of 
dimension. 
[0006] 

Although face image composition using PCA is also performed, it is difficult to direct and extract the principal 
component about age or expression in the feature extraction of the conventional technique. When throwing in as 
data two or more face images with which age differs and analyzing them, it is fully considered that the result that 
the component which participates in age change was included in the principal component of a high order is obtained 
from the property of PCA. However, in order to acquire the principal component which involves to age change 
strongly from the obtained result, data were restored for every principal component and the method of choosing 
with subjectivity the principal component which will seemingly be reasonable has been taken. Therefore, the results 
obtained by those who choose a principal component will differ. 
[0007] 

The purpose of this invention is related with the image processing system, the image-processing approach, and 
image-processing program which can be extracted without depending the description of the predetermined attribute 
of an image on subjectivity. 
[0008] 

[The means for solving a technical problem and an effect of the invention] 

An image storage means by which the image processing system concerning the 1st invention memorizes two or 
more images, A feature-extraction means to extract two or more gesta It-descriptions of each image memorized by 



http://www4.ipdl.ncipi.gojp/cgi-bin/tran_web.cgLeije 



2006/05/01 



JP.2004-102359.A [DETAILED DESCRIPTION] 



2/11 *<—i> 



the image storage means, A gestalt feature- vector configuration means to constitute the gestatt feature vector for 
every image which makes a variate the attribute of each image acquired by attribute acquisition means to acquire 
the attribute of each different image from the gestalt-description, and two or more gesta It-descriptions and 
attribute acquisition means of each image which were extracted by the feature-extraction means. It has a principal- 
component-analysis means to compute the 1st principal component by principal component analysis from the 
gestalt feature vector of two or more images constituted by the gestalt feature- vector configuration means. 
[0009] 

In the image processing system concerning this invention, two or more images are memorized by the image storage 
means, and two or more gestalt-descriptions of each memorized image are extracted by the feature- extraction 
means. Moreover, the attribute of each different image from the gestalt-description is acquired by the attribute 
acquisition means. The gestalt feature vector for every image which makes a variate two or more gestalt- 
descriptions of each extracted image and the acquired attribute of each image is constituted by the gestalt feature- 
vector configuration means. The 1st principal component is computed by principal component analysis with a 
principal-component-analysis means from the gestalt feature vector of two or more constituted images. 
[0010] 

Thus, the 1st obtained principal component is involving closely with the attribute applied to the gestalt feature 
vector as a variate. Therefore, it can extract certainly, without depending the predetermined description of an image 
on subjectivity based on the 1st principal component. 
[0011] 

In the configuration of the image processing system which the image processing system concerning the 2nd 
invention requires for the 1st invention A variability region decision means to determine the variability region of the 
1st principal component using the characteristic value of the 1st principal component computed by the principal- 
component-analysis means. It is characterized by having further an attribute feature -vector reconstruction means 
to reconfigurate the attribute feature vector which shows the description of an attribute, using as a variate the 
variation of two or more gestalt-descriptions in the variability region of the 1st principal component determined by 
the variability region decision means. 
[0012] 

In this case, the variability region of the 1st principal component is determined by the variability region decision 
means using the characteristic value of the 1st principal component computed by the principal-component-analysis 
means. Moreover, the attribute feature vector which shows the description of an attribute, using the variation of two 
or more gestalt-descriptions in the variability region of the 1st determined principal component as a variate is 
reconfigurated by the attribute feature- vector reconstruction means. 
[0013] 

Thus, each variate of the obtained attribute feature vector shows the variation of each gestalt-description by 
change of an attribute. Therefore, the description of the attribute of an image can be extracted as variation of each 
gestalt-description. 
[0014] 

The image processing system concerning the 3rd invention is characterized by having further an image composition 
means to compound other images with which attributes differ from a specific image using the attribute feature 
vector obtained by the attribute feature-vector reconstruction means in the configuration of the image processing 
system concerning the 2nd invention. 
[0015] 

In this case, since each variate of an attribute feature vector shows the variation of each gestalt-description by 
change of the attribute of an image, other images with which attributes differ from a specific image using an 
attribute feature vector are compoundable. 
[0016] 

The image processing system concerning the 4th invention is characterized by compounding other images from the 
gestalt feature vector which it sets in the configuration of the image processing system concerning the 3rd 
invention, and an image composition means constitutes the gestalt feature vector which makes a variate two or 
more gestalt-descriptions of a specific image, corrects each variate of the gestalt feature vector based on the 
variate to which an attribute feature vector corresponds, and has the corrected variate. 
[0017] 

In this case, the gestalt feature vector which makes a variate two or more gestalt-descriptions of a specific image is 
constituted, and other images are compounded from the gestalt feature vector which each variate of that gestalt 
feature vector is corrected based on the variate to which an attribute feature vector corresponds, and has the 
corrected variate. Thus, other images with which attributes differ from a specific image using an attribute feature 
vector are compoundable. 
[0018] 

In the configuration of the image processing system which the image processing system concerning the 5th 
invention requires for the 1st - one of invention of the 4th, two or more images are two or more face images, and an 
attribute is characterized by being age, real age, sex, a race, an apparent expression, or an apparent bodily shape. 
[0019] 

When an attribute is apparent age, the 1st principal component obtained by principal component analysis is involving 
closely with apparent age by adding apparent age to a gestalt feature vector as a variate. Therefore, it can extract 
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certainly, without depending the description of the age of the appearance of a face image on subjectivity based on 
the 1st principal component. When an attribute is real age, the 1st principal component obtained by principal 
component analysis is involving closely with real age by adding real age to a gestalt feature vector as a variate. 
Therefore, it can extract certainly, without depending the description of the real age of a face image on subjectivity 
based on the 1st principal component. When an attribute is sex, the 1st principal component obtained by principal 
component analysis is involving closely with sex by adding sex to a gestalt feature vector as a variate. Therefore, it 
can extract certainly, without depending the description of the sex of a face image on subjectivity based on the 1st 
principal component. When an attribute is a race, the 1st principal component obtained by principal component 
analysis is involving closely with the race by adding a race to a gestalt feature vector as a variate. Therefore, it can 
extract certainly, without depending the description of the race of a face image on subjectivity based on the 1st 
principal component. When an attribute is expression, the 1st principal component obtained by principal component 
analysis is involving closely with expression by adding expression to a gestalt feature vector as a variate. Therefore, 
it can extract certainly, without depending the description of the expression of a face image on subjectivity based 
on the 1st principal component. When an attribute is a bodily shape, the 1st principal component obtained by 
principal component analysis is involving closely with a bodily shape by adding a bodily shape to a gestalt feature 
vector as a variate. Therefore, it can extract certainty, without depending the description of the bodily shape of a 
face image on subjectivity based on the 1st principal component. 
[0020] 

In the configuration of the image processing system which the image processing system concerning the 6th 
invention requires for the 1st - one of invention of the 5th, two or more gesta It-descriptions are characterized by 
including the coordinate value of two or more focus defined beforehand. 
[0021] 

In this case, two or more gesta It-descriptions are expressed by the coordinate value of two or more focus. 
Therefore, it can extract certainly, without the 1st principal component twisting the description of the attribute in 
the configuration of an image to subjectivity. 
[0022] 

The step the image-processing approach concerning the 7th invention remembers two or more images to be, The 
step which extracts two or more gestalt-descriptions of each memorized image, and the step which acquires the 
attribute of each different image from the gesta It-description, It has the step which constitutes the gestalt feature 
vector for every image which makes a variate two or more gestalt-descriptions of each extracted image, and the 
acquired attribute of each image, and the step which computes the 1st principal component by principal component 
analysis from the gestalt feature vector of two or more constituted images. 
[0023] 

In the image-processing approach concerning this invention, two or more images are memorized and two or more 
gestalt-descriptions of each memorized image are extracted. Moreover, the attribute of each different image from 
the gesta It-description is acquired. The gestalt feature vector for every image which makes a variate two or more 
gestalt-descriptions of each extracted image and the acquired attribute of each image is constituted. The 1st 
principal component is computed by principal component analysis from the gestalt feature vector of two or more 
constituted images. 
[0024] 

Thus, the 1st obtained principal component is involving closely with the attribute applied to the gestalt feature 
vector as a variate. Therefore, it can extract certainly, without depending the predetermined description of an image 
on subjectivity based on the 1st principal component. 
[0025] 

The processing which the image-processing program concerning the 8th invention is an image-processing program 
in which computer reading is possible, is the image-processing program in which computer reading is possible, and 
memorizes two or more images. The processing which extracts two or more gestalt-descriptions of each memorized 
image, and the processing which acquires the attribute of each different image from the gesta It-description, The 
processing which constitutes the gestalt feature vector for every image which makes a variate two or more gestalt- 
descriptions of each extracted image, and the acquired attribute of each image, A computer is made to perform 
processing which computes the 1st principal component by principal component analysis from the gestalt feature 
vector of two or more constituted images. 
[0026] 

According to the image-processing program concerning this invention, two or more images are memorized and two 
or more gestalt-descriptions of each memorized image are extracted. Moreover, the attribute of each different 
image from the gestalt-description is acquired. The gestalt feature vector for every image which makes a variate 
two or more gestalt-descriptions of each extracted image and the acquired attribute of each image is constituted. 
The 1st principal component is computed by principal component analysis from the gestalt feature vector of two or 
more constituted images. 
[0027] 

Thus, the 1 st obtained principal component is involving closely with the attribute applied to the gestalt feature 
vector as a variate. Therefore, it can extract certainly, without depending the predetermined description of an image 
on subjectivity based on the 1st principal component. 
[0028] 
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[Embodiment of the Invention] 

Hereafter, the concept of the image-processing approach in the gestatt of 1 operation of this invention is explained. 
Here, an image is an individual face image, it is the two-dimensional coordinate of the L focus (x y) from which two 
or more gestalt-descriptions constitute the shape facility of face parts (face components), such as an eye and 
opening, and the case where an attribute is age is explained Here, L is two or more integers and an x-coordinate 
[ in / in x / a face image ] and y are the y-coordinates in a face image. 
[0029] 

With the gestalt of this operation , first , as a feature vector ( shape facility vector ) showing an individual face 
image , what applied weight to the known attribute value ( age attribute value ) which affect it with the age 
description strongly be add as a variate a , and although there be no direct relation not only to the two-dimensional 
coordinate of the L focus ( x y ) but an image , as show below , dimension compression by principal component 
analysis ( PCA ) be perform . 
[0030] 

Specifically, the following procedures perform. The shape facility vector of an individual face image is expressed like 

a degree type as a 2L+1 dimension vector Fi (i= 1, 2 M). M is the number of the individual face images used for 

PCA. 
[0031] 

Fi=(x1, yl. x2. y2, x3 and y3, — , [xL, yL. a]) T — (1) 

In an upper type (1), T shows transposition. Average FAV is lengthened from each element (variate) so that the 
average value of the shape facility vector of all face images may be arranged at the core of shape facility vector 
space. 
[0032] 

deltaFi=Fi-FAV — (2) 

Next, a degree type (3) newly defines the face feature space G using an upper type (2). 
[0033] 

G= [delta FI. delta F2, — , delta FM] — (3) 

And it asks for the covariance matrix S of the face feature space G by the degree type (4). 
[0034] 

S=GGT — (4) 

By performing a singular value decomposition by the degree type (5) to the covariance matrix S called for from the 
upper type (4), it can ask for each characteristic vector as a principal component of the face feature space G. 
[0035] 

S=UDUT — (5) 

U is a unitary matrix and each train serves as a characteristic vector. That is, the principal component score of the 
3rd principal component [ in / in the principal component score of the 2nd principal component / in / in a list and 
the 2nd train / in the principal component score of the 1st principal component / in / in the 1st train of unitary- 
matrix U / the 1st - the Mth face image / the 1st - the Mth face image / the 1st - the Mth face image ] is located 
in a line with a list and the 3rd train in order in order at order. Similarly, the principal component score of the ** 
(2L+1) principal component in the 1st - the Mth face image is located in a line with the Mth train of unitary- matrix 
U. D is a diagonal matrix and a diagonal element is the characteristic value of each principal component. That is, the 
diagonal element of a diagonal matrix D is characteristic value lambda 1-lambda2L+1 of the 1st principal component 
- a ** (2L+1) principal component 
[0036] 

It is strongly influenced of the component (age) added as attribute value, and the value of a principal component 
score of the 1st principal component becomes what reflected age attribute value strongly so that the 1st principal 
component obtained here may be mentioned later. 
[0037] 

Here, set standard deviation of the 1st principal component to sigmal, and let the 3 times be the variability region of 
a shape facility. Since the characteristic value of a principal component is distribution of a principal component, 
standard deviation sigmal of the 1st principal component becomes like [ characteristic value / lambda 1 / of the 
1st principal component ] a degree type (6). 
[0038] 

sigmal 2=lambda1 — (6) 

Let the 3 times as many range of standard deviation sigmal of the 1st principal component as this, i.e., the range of 
-(3/2) sigmal to +(3/2) sigmal, be a face form-like (shape facility) variability region. 90% or more of all face images 
belongs to this variability region. + Set to Pmax the principal component feature vector which considers 3 / 2sigma1 
as the principal component score of the 1st principal component, and sets the principal component score of other 
principal components to 0. Moreover, the principal component feature vector which considers -(3/2) sigmal as the 
principal component score of the 1st principal component and sets the principal component score of other principal 
components to 0 is set to Pmin. Principal component feature-vector Pmax corresponds to the oldest (or youngest) 
face image in the average face image called for from M face images, and principal component feature-vector Pmin 
corresponds to the youngest (or oldest) face image in the average face image called for with M face images. 
[0039] 

Pmax=(+(3/2) sigmal, and [0, 0, — . 0]) T — (7) 
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Pmin=(-(3/2) sigmal, and [0. 0. — , 0]) T — (8) 

The face form-like vectors Fmax and Fmin are reconfigurated from principal component feature-vector Pmax of an 
upper type (7) and (8). and Pmin. The face form-like vector Fmax expresses the oldest (or youngest) average face 
image, and the face form-like vector Fmin expresses the youngest (or oldest) average face image. And the 
difference of the face form-like vector Fmax and the face form-like vector Fmin is extracted as feature-vector (age 
feature vector) F showing the age description like a degree type. 
[0040] 

F=Fmax-Fmin — (9) 

However, since attribute value is unnecessary to age feature-vector F, age feature-vector F is taken as the 2L 

dimension vector which deleted age attribute value at it. 

[0041] 

F= [x1, y1. x2. y2, — , x2U y2L] — T — (10) 

Age feature-vector F of an upper type (10) expresses the movement magnitude of each focus between the oldest 
average face image and the youngest average face image. For example, a variate x1 expresses the movement 
magnitude of the x-coordinate of the 1st focus, and a variate yl expresses the movement magnitude of the y- 
coordinate of the 1st focus. 
[0042] 

The face image of the age when the individuals differ from a specific individual's original face image as follows using 

age feature -vector F of an upper type (10) is compoundable. 

[0043] 

First, the shape facility vector Fl of a specific individual's original face image is constituted like a degree type. 
[0044] 

FI= [x1, y1, x2. y2, — , x2l_ y2L] — T — (1 1) 

The variates xl and y1 of an upper type (11), x2, y2, — , x2l_ and y2L are the x-coordinates and y-coordinates of 

the L focus of an original face image. 

[0045] 

Next, the multiplication of the synthetic rate b is carried out to each variates x1 and yl of age feature-vector F of 

an upper type (10), x2, y2, — , x2L, and y2L, and correction vector F* of a degree type is computed. 

[0046] 

P= [bx1 f byl, bx2, by2, — , bx2L, by2L] — T — (12) 

Correction vector F of a top type (12) is added or subtracted like a degree type to the shape facility vector FI of an 
upper-type (11) original face image, and the shape facility vector FS which mapped the age description is created. 
[0047] 

FS=FI**F — (13) 

The face image with which age differs to an original face image is compoundable by reconfigurating a face image 
from the shape facility vector FS of an upper type (13). In this case, it becomes possible by setting the value of the 
synthetic rate b in an upper type (12) as arbitration to compound the face image of the age of arbitration. 
[0048] 

Next, the configuration of the image processing system for performing the image-processing approach of the gestalt 
this operation using drawing 1 is explained. Drawing 1 is the block diagram showing the configuration of the image 
processing system for enforcing the image-processing approach of the gestalt this operation. 
[0049] 

An image processing system 50 includes CPU (arithmetic and program control)501, ROM (read-only memory)502, 
RAM (random access memory)503. an input unit 504, a display 505, external storage 506, the record-medium driving 
gear 507, and an airline printer 508. 
[0050] 

An input device 504 consists of a keyboard, a mouse, a scanner, a digital camera, etc., and it is used in order to 
input various commands, data, and an image. A system program is memorized by ROM502. The record-medium 
driving gear 507 consists of a CD-ROM drive, a floppy disk drive, etc., and write data to the record media 509, such 
as CD-ROM and a floppy disk. [ reading and ] The image-processing program is memorized by the record medium 
509. External storage 506 consists of a hard disk drive unit etc., and the image-processing program and the various 
data which were read from the record medium 509 through the record-medium driving gear 507 are memorized. 
CPU501 performs the image-processing program memorized by external storage 506 on RAM503. 
[0051] 

A display 505 consists of a liquid crystal display panel, CRT (cathode-ray tube), etc., and displays various images 

etc. An airline printer 508 prints various images etc. 

[0052] 

In addition, various record media, such as semiconductor memory, such as ROM. and a hard disk, can be used as a 
record medium 509 which records an image-processing program. Moreover, an image-processing program may be 
downloaded to external storage 506 through communication media, such as a communication line, and you may 
perform on RAM503. 
[0053] 

With the gestalt of this operation, external storage 506 is equivalent to an image storage means, and CPU501 is 
equivalent to a feature-extraction means, an attribute acquisition means, a gestalt feature-vector configuration 
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means, a principal-component-analysis means, a variability region decision means, an attribute feature-vector 

reconstruction means, and an image composition means. 

[0054] 

Drawing 2 is a flow chart which shows processing of the image-processing program performed in the image 
processing system of drawing 1 . Here, the example of the approach of compounding the face image of other age of 
the individual from the original face image of the individual of a certain age is shown. 
[0055] 

First, CPU501 is memorized to external storage 506 by making into image data two or more individuals* face image 
inputted by the input device 504 (step SI). In this case, the image data of two or more individuals' face image 
beforehand memorized by the database may be used. 
[0056] 

Next, CPU 501 extracts the coordinate value of two or more focus of each face image based on the image data 
memorized by external storage 506 (step S2). With the gestalt of this operation, the x-coordinate and y-coordinate 
of each focus are extracted. 
[0057] 

Next. CPU501 acquires the age attribute value of each face image (step S3). The age attribute value which could 
input with the input device 504 for every face image, or was beforehand memorized by the database for every face 
image may be used for age attribute value. With the gestalt of this operation, the age of the appearance obtained by 
the age consciousness experiment mentioned later is used as age attribute value. 
[0058] 

Furthermore, CPU501 constitutes the shape facility vector Fi (refer to formula (1)) of each face image using two or 
more coordinate values and age attribute value of the focus which were extracted for every face image (step S4). 
[0059] 

Subsequently, CPU501 computes characteristic value sigmal of the 1st principal component by principal component 
analysis according to formula (2) - (6) from the shape facility vector Fi of two or more face images (step S5). 
Moreover, CPU501 constitutes principal component feature- vector Pmax of the 1st principal component of a 
formula (7), and Pmin using characteristic value sigmal of the 1st principal component (step S6). 
[0060] 

Next, CPU501 reconfigurates the face form-like vectors Fmax and Fmin of the 1 st principal component of a formula 
(7) using characteristic value sigmal of the 1st principal component (step S7), and age feature-vector F showing the 
age description of a formula (8) is extracted (step S8). 
[0061] 

Subsequently, CPU501 compounds the face image of desired age from a specific individual's original face image 

using age feature- vector F (step S9). 

[0062] 

Thus, by performing an image-processing program in an image processing system, the description of the shape of a 
face form which relates to the age description closely using two or more individuals' face image can be extracted as 
age feature-vector F, and the face image of desired age can be compounded from a specific individual's original face 
image using the description of the shape of a face form extracted further. 
[0063] 

As mentioned above, since a strange face image is compoundable with the image processing system, the image- 
processing approach, and image-processing program of a gestalt of this operation, they can be used for a criminal 
investigation etc. 
[0064] 

In addition, although the coordinate value of two or more focus which expresses the face form-like description as a 
gestalt-description of an image is used with the gestalt of the above-mentioned implementation, textures (******), 
such as a tint of the skin, a stain, and a wrinkling, can also be used as a gestalt-description of an image. Moreover, 
the consciousness of age may take into consideration not only the configuration inside a face but a hairstyle etc. 
[0065] 

Furthermore, with the gestalt of the above-mentioned implementation, although apparent age is used as an attribute, 
real age may be used instead of apparent age as an attribute. Moreover, other attributes, such as expression, a race, 
sex, and a bodily shape, may be used as an attribute. 
[0066] 

When an attribute is real age, by applying the image-processing approach of the gestalt the above-mentioned 
implementation, the description of the shape of a face form which relates to the description of real age closely using 
two or more individuals' face image can be extracted, and the face image with which real age differs from a specific 
individual's original face image using the description of the shape of a face form extracted further can be 
compounded. 
[0067] 

When an attribute is expression, by expressing expression, such as joy, anger, humor and pathos, with a value 
different, respectively, and applying the image-processing approach of the gestalt the above-mentioned 
implementation, the description of the shape of a face form which relates to the description of expression closely 
using two or more individuals' face image can be extracted, and the face image with which expression differs from a 
specific individual's original face image using the description of the shape of a face form extracted further can be 
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compounded. 
[0068] 

By expressing two or more different races with a value different respectively, and applying the image-processing 
approach of the gestalt the above-mentioned implementation, when an attribute is a race, the description of the 
shape of a face form which relates to the racial description closely using two or more individuals* face image can be 
extracted, and the face image with which races differ from a specific individual's original face image using the 
description of the shape of a face form extracted further can compound. 
[0069] 

When an attribute is sex, by expressing man and woman's sex with a different value, and applying the image- 
processing approach of the gestalt the above-mentioned implementation, the description of the shape of a face 
form which relates to the description of sex closely using two or more individuals' face image can be extracted, and 
the face image with which sex differs from a specific individual's original face image using the description of the 
shape of a face form extracted further can be compounded. 
[0070] 

By expressing a different bodily shape with a different value, and applying the image-processing approach of the 
gestalt the above-mentioned implementation, when an attribute is a bodily shape, the description of the shape of a 
face form which relates to the description of a bodily shape closely using two or more individuals' face image can be 
extracted, and the face image with which bodily shape differs from a specific individual's original face image using 
the description of the shape of a face form extracted further can be compounded. 
[0071] 

Moreover, although the gestalt of the above-mentioned implementation explained the case where an image was an 

individual face image, it is not limited to this. For example, an image may be an image of an animal. 

[0072] 

[Example] 

1. Preliminary Experiment 

What is necessary is just to use real age as attribute value given to the variate of PCA, when considering the shape 
facility in connection with secular change of an individual face. However, it is experientially clear that a stain, the 
texture of a wrinkling and the skin, etc. change with a configuration in secular change of a face. This example 
examined the description of the configuration of not the shape facility of a face that changes with secular change 
but apparent age, i.e., the face which looks young, and the face which becomes old and is visible. And since it was 
inadequate as attribute value of apparent age to have given real age, in order to calculate the attribute value of 
apparent age, the age consciousness experiment (age consultation experiment) was conducted. 
[0073] 

1—1. Procedure 

142 Japanese man and woman's each amimia, the transverse-plane sense, and real age used the face image in the 
second half of the 10th generation to the second half of the 30th generation for the experiment stimulus in an age 
consciousness experiment from the expression face image database of ATR (Advanced Telecommunications 
Research Institute, Inc.). Moreover, the face image was a 51 2x51 2-pixel color picture, and the face was the 
magnitude which enters within the limit enough. The test subject was a college student's (18 years old - 22 years 
old) 25 men and 22 women. 
[0074] 

The experiment was conducted in the following procedure. The test subject presumed the age of the face image 
displayed on a monitor, and he was called for so that the category which is most suitable in the age consultation 
category shown in Table 1 might be chosen. 
[0075] 
[Table 1] 
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[0076] 

As shown in Table 1, age was classified into eight categories and the consultation value of 0-7 was given to those 

categories at the young order of age. 

[0077] 

1- 2. Result 

It asked for an average and standard deviation of a consultation value for every face image. Drawing 4 is drawing 
which rearranged the average of criticism stationing for every face image into descending order, and plotted it. The 
axis of abscissa of drawin g 4 shows 142 persons' face image, and an axis of ordinate shows the average of the 
consultation value of each face image. The trigonum mark and a round mark express the average of the consultation 
value of the face image of a male and a woman, respectively. 
[0078] 

It asked for the average for every sex of a face image from the standard deviation obtained from each face image. 
The average of standard deviation was 0.89 in 0.85 and a female face image by the male face image. That is, it 
means that age was presumed to be also man and woman's face with the error of about **5 years old. 
[0079] 

In addition, since face images differ with man and woman and it is unrelated between face images, there is no 

semantics in the comparison between face images. 

[0080] 

2. Age Feature -Extraction Experiment 

Next, the face age feature-extraction experiment was conducted using the age attribute value of the appearance 
obtained by the above-mentioned age consciousness experiment The shape facility extracted was compared by the 
case (it is hereafter called attribute value addition conditions) where apparent age attribute value is added to face 
information, and the case (it is hereafter called attribute- value-less conditions) where apparent age attribute value 
is not added to face information. 
[0081] 

2- 1. Procedure 

In the shape facility of a face image The face image composition system of ATR ((FUTON)) [ Miyuki Kamaike, 
Mukoda **, Yoshikawa Hidari / Noriko /, Kato **, Oda / Masaomi /, red Matsushige, and "face image composition 
system-FUTON System/ for the mental experiment about a face and expression cognition /-" **** technique HIP 
97-39, pp.73-80, ] [ Jan.1998] And the coordinate value of the 83 default focus of Mukoda **, Kamaike [ Miyuki ], 
red Matsushige, and "evaluation of the manual sampling in face image composition system (FUTON system)" **** 
technique, HIP 99-49, pp.13-18, and Nov.1999 reference was used. Drawing 5 | s drawing showing the focus used as 
a variate of a face feature vector. In drawing 5 . a black dot shows the focus of 83 points, and in order to identify 
each focus, the sign is attached. 
[0082] 

As a face image, man and woman's face image of 142 sheets each used by preliminary experiment was used. 
However, it normalized so that a lace width (die length between the focus Fl [ Fr3 and ] 3) might become 230 pixels, 
and so that the straight line which connects the pupil of both eyes might become level. 
[0083] 

In each of attribute-value-less conditions and attribute value addition conditions, dimension compression by PCA 
was performed for every face image of man and woman. 

- Attribute-value-less conditions 

On the attribute-value-less conditions of the conventional technique, only the coordinate value of the focus of 83 
points was used as face information (variate of a shape facility vector). The face image of one sheet was expressed 
as a 166-dimensional shape facility vector FN. 
[0084] 

FN=(x1, yl. x2, y2, x3 and y3, — x83, y83) T 

- Attribute value addition conditions 

On attribute value addition conditions, the value which doubled the average of the consultation value of each face 
image which was obtained by preliminary experiment as face information in addition to (the variate of a shape facility 
vector) and the coordinate value of the focus of 83 points 100 was used as apparent age attribute value a. And the 
face image of one sheet was expressed as a 167-dimensional shape facility vector FA. 
[0085] 

FA=(x1, yl, x2, y2, x3 and y3, — , x83, y83, a) T 

From the characteristic value for every obtained principal component, the variation of the principal component was 

determined and the difference was visually compared after re configurating a shape facility vector for every principal 

component. 

[0086] 

2-3. Result 

About each man and woman's face image, the principal component score in each principal component obtained from 
attribute-value-less conditions and attribute value addition conditions was analyzed. If the principal component was 
involving to age change strongly, when a face image is arranged in order of age, the principal component score of 
each face image on a principal component should be located in a line with ascending order or descending order. 
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Then, the principal component score from the 1st principal component to the 3rd principal component was plotted 

among the principal components obtained with the monograph affair in man and woman's face image. 

[0087] 

Drawing showing the principal component score of a high order principal component when drawin g 6 (a) was 
obtained on attribute-value-less conditions in the male face image, and drawing 6 (b) are drawings showing the 
principal component score of the high order principal component obtained on attribute-value-less conditions in the 
female face image. Moreover, drawing showing the principal component score of a high order principal component 
when drawing 7 (a) was obtained on attribute value addition conditions in the male face image, and drawing 7 (b) are 
drawings showing the principal component score of the high order principal component obtained on attribute value 
addition conditions in the female face image. The axis of abscissa of drawing 6 and drawing 7 shows the face image 
arranged in the high order of apparent age (consultation value), and an axis of ordinate shows a principal component 
score (PC score). The square mark shows the principal component score of the 1st principal component, a round 
mark shows the principal component score of the 2nd principal component, and the trigonum mark shows the 
principal component score of the 3rd principal component. 
[0088] 

As shown in drawing 6 (a) and (b), on attribute-value-less conditions, the principal component to which the principal 
component score of the face image compared also with the male face image and the female face image in order of 
age is mostly located in a line with ascending order or descending order was not able to be found. 
[0089] 

As shown in drawing 7 (a) and (b), it was shown on attribute value addition conditions by the form where the 
principal component score of the 1st principal component was mostly located in a line also with the male face image 
and the female face image in order. 
[0090] 

These results showed that the 1 st principal component obtained on attribute value addition conditions was closely 

related to the description which affects the age of the appearance of a face image. 

[0091] 

Next, in order to check visually with what kind of form status change-ization each principal component is concerned, 
the coordinate of the focus of face parts was re configurated using the variability region obtained from the 
characteristic value of the principal component to check, respectively. As shown below, the effect of the shape of a 
face form on the principal component in attribute value addition conditions was investigated. 
[0092] 

Drawing 8 , drawing 9 , drawing 10 , and drawing 1 1 are drawings showing the shape of a face form reconfigurated 
using respectively the 1st principal component obtained on attribute value addition conditions in the male face 
image, the 2nd principal component, the 3rd principal component, and the 4th principal component. Moreover, 
drawing 12 , drawing 13 , drawing 14 , and drawing 15 are drawings showing the shape of a face form reconfigurated 
using respectively the 1st principal component obtained on attribute value addition conditions in the female face 
image, the 2nd principal component, the 3rd principal component, and the 4th principal component In drawing 8 - 
drawjngj 1 . (a) and (b) show the shape of a face form with apparent going too far age. 
[0093] 

The shape of a face form of two sheets of each principal component was compared from the reconfigurated face 
image. When it mentions as a subjective impression how it is related to change of the description with each 
geometrical principal component, about it, it is as follows. With the 1st principal component obtained on attribute 
value addition conditions about the male face image, as for change and an outside, the inside of eyebrows changes 
to the reverse sense up and down with the inside. A nose and opening change up and down, narrow a little, spread, a 
jaw becomes a little large, or the width of face of opening becomes small. With the 2nd principal component, the 
outside of eyebrows changes horizontally (the magnitude of eyebrows changes), and spacing of both eyes also 
becomes a little large, it becomes [ a frame carries out enlarging or contracting, and ] narrow, and a nose, opening, 
and a jaw change up and down a lot. With the 3rd principal component, the inside of eyebrows changes up and down 
and an outside changes horizontally a little. A nose and opening change up and down a lot, it is somewhat small and 
a jaw changes to the form [ like ] which **** stretched a little squarely, and the form where it sharpened. With the 
4th principal component, the magnitude of a frame changes rapidly and the inside of eyebrows changes up and down 
a lot. And the left-hand side of a nose and opening changes horizontally a little, and the left-hand side of a jaw 
changes very only. 
[0094] 

On the other hand, on attribute- value- less conditions, the 1st principal component showed the almost same change 
as the 2nd principal component of attribute value addition conditions, and the 2nd principal component showed the 
almost same change as the 3rd principal component of attribute value addition conditions on them. The same was 
said of subsequent principal components. 
[0095] 

With the 1st principal component obtained on attribute value addition conditions about the female face image, it 
changes up and down, and width of face becomes large or opening becomes narrow. And a jaw becomes a little large 
or becomes small. It was the same as that of the 2nd principal component obtained on attribute value addition 
conditions about the male face image in the 2nd principal component almost. With the 3rd principal component, a 
frame carries out enlarging or contracting, the inside of eyebrows changes up and down a little, and a nose and 
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opening change horizontally [ on the left-hand side ] a little, it is somewhat small and a jaw becomes the form 
[ like ] which **** stretched a little, and the form where it sharpened. With the 4th principal component, a face 
profile, a nose, and opening change on the right-hand side a little. And breadth changes about a face profile. 
[0096] 

On the other hand, like the male face image, on attribute-value-less conditions, the 1st principal component showed 
the almost same change as the 2nd principal component of attribute value addition conditions, and the 2nd principal 
component showed the almost same change as the 3rd principal component of attribute value addition conditions on 
them. The same was said of subsequent principal components. 
[0097] 

2- 3. Consideration 

If it sees from distribution of the principal component score in each principal component, since the principal 
component score had not become ascending order or descending order at all when a face image was arranged in 
order of apparent age, henceforth [ the 2nd principal component of attribute-value-less conditions and attribute 
value addition conditions ]. it cannot be said that these principal components are closely related to the description 
which affects apparent age. When a face image is arranged in order of apparent age with the 1st principal 
component of attribute value addition conditions on the other hand, From that the principal component score was 
mostly located in a line also with man and woman's face image in order, and the distribution of data (consultation 
value) and the distribution of the data (principal component score) of the 1st principal component which were 
further acquired in the age consciousness experiment (age consultation experiment) showing the well alike 
distribution It can be said that the 1st principal component obtained on attribute value addition conditions is closely 
related to the shape facility which affects apparent age. 
[0098] 

Changing the value of a principal component score of each principal component, the 1st principal component of 
attribute value addition conditions seems to suit aging change of the adolescence by anatomical knowledge mostly 
also about change of the coordinate of the focus which the focus coordinate of face parts was made to 
re configurate. 
[0099] 

By applying the attribute value of the apparent age of being unrelated to the configuration of not only the coordinate 
value of the focus which is the configuration information on a face but a direct face image, by the image-processing 
approach concerning this invention, and performing PCA Since also qualitatively appropriate deformation was 
observable in the shape of that the principal component score of the 1st principal component shows relation with 
age change also quantitatively, and a face form reconfigurated from the 1st principal component, it is shown that the 
shape facility which is closely related to apparent age can be obtained. 
[0100] 

3- 1. Mapping to Individual Face Image 

The age description of the appearance obtained by age feature-extraction experiment was mapped to the individual 

face image. 

[0101] 

Drawing 16 - drawing 19 are drawings showing the result of having compounded the face image with which age 
differs by mapping an age shape facility in four persons* original face image. In each drawing, centers are an original 
face image, the face image compounded so that left-hand side might look young, and the image compounded so that 
right-hand side could become old and be seen among the face images of three sheets. Each synthetic rate was 
made into **50% of the variation of the 1st principal component of the attribute value addition conditions of an age 
feature-extraction experiment 
[0102] 

The composite procedure is as follows. The focus of 83 points used by FUTON is acquired from an individual original 
face image, and let the shape facility vector FI of an original face image be the 166-dimensional vector FI using the 
coordinate value of the focus. 
FI=(x1. y1. x2. x3. — . x166, y166)T — (11) 

Correction vector F' which multiplied each element of the shape facility vector FI of an original face image and 
apparent age feature- vector F by the synthetic rate 0.5 was added or subtracted, and the face form-like vector FS 
which mapped the age description was created. 
[0103] 

F=(0.5x1. 0.5y1, 0.5 x2. and 0.5y2 — , 0.5x83, 0.5y83) T — (12) 
FS=FI**P — (13) 

And the shape of a face form performed configuration morpning (face composition technique) which changes from FI 

to FS by FUTON. 

[0104] 

Here, since the age description of the extracted appearance was only a configuration, it became face form-like 
composition, a synthetic result — " — the person of an original face image is seen youthfully — if it becomes — 
such sensibility" — " — it became the face image of the impression such sensibility" if it becomes seen by 
becoming old. 
[0105] 

As mentioned above, in the above-mentioned example, it was shown by by applying the attribute value of the age of 
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appearance without the direct relation to an image to the shape facility vector of a face image as a variate, and 
performing PCA that it is possible to extract the shape facility which participates in an apparent age change closely. 

[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of the image processing system for enforcing the 
image-processing approach in the gestatt of 1 operation of this invention. 

[Drawing 2] It is the flow chart which shows processing of the image-processing program performed in the image 
processing system of drawing 1 . 

[Drawing 3] It is the flow chart which shows processing of the image-processing program performed in the image 
processing system of drawing 1 . 

[Drawing 4] It is drawing which rearranged the average of criticism stationing for every face image into descending 
order, and plotted it. 

[Drawing 5] It is drawing showing the focus used as a variate of a shape facility vector. 

[Drawing 6] It is drawing showing the principal component score of the high order principal component obtained on 
attribute-value-less conditions in the face image of a male and a woman. 

[Drawing 7] It is drawing showing the principal component score of the high order principal component obtained on 
attribute value addition conditions in the face image of a male and a woman. 

[Drawing 8] It is drawing showing the shape of a face form reconfigurated using respectively the 1st principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 9] It is drawing showing the shape of a face form reconfigurated using respectively the 2nd principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 10] It is drawing showing the shape of a face form reconfigurated using respectively the 3rd principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 11] It is drawing showing the shape of a face form reconfigurated using respectively the 4th principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 12] It is drawing showing the shape of a face form reconfigurated using respectively the 1st principal 
component obtained on attribute addition conditions in the female face image. 

[Drawing 13] It is drawing showing the shape of a face form reconfigurated using respectively the 2nd principal 
component obtained on attribute addition conditions in the female face image. 

[Drawing 14] It is drawing showing the shape of a face form reconfigurated using respectively the 3rd principal 
component obtained on attribute addition conditions in the female face image. 

[Drawing 15] It is drawing showing the shape of a face form reconfigurated using respectively the 4th principal 
component obtained on attribute addition conditions in the female face image. 

[Drawing 16] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 

[Drawing 17] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 

[Drawing 18] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 

[Drawing 19] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 
[Description of Notations] 
50 Image Processing System 

501 CPU 

502 ROM 

503 RAM 

504 Input Unit 

505 Display 

506 External Storage 

507 Record-Medium Driving Gear 

508 Airline Printer 

509 Record Medium 



[Translation done.] 
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[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of the image processing system for enforcing the 
image-processing approach in the gestatt of 1 operation of this invention. 

[Drawing 2] It is the flow chart which shows processing of the image-processing program performed in the image 
processing system of drawing 1 . 

[Drawing 3] It is the flow chart which shows processing of the image-processing program performed in the image 
processing system of drawing 1 . 

[QjrawiUgJfl It is drawing which rearranged the average of criticism stationing for every face image into descending 
order, and plotted it. 

[Drawing 5] It is drawing showing the focus used as a variate of a shape facility vector. 

[Drawing 6] It is drawing showing the principal component score of the high order principal component obtained on 
attribute-value-less conditions in the face image of a male and a woman. 

[Drawing 7] It is drawing showing the principal component score of the high order principal component obtained on 
attribute value addition conditions in the face image of a male and a woman. 

[Drawing 8] It is drawing showing the shape of a face form re configurated using respectively the 1st principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 9] It is drawing showing the shape of a face form reconfigurated using respectively the 2nd principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 10] It is drawing showing the shape of a face form reconfigurated using respectively the 3rd principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 1 1] It is drawing showing the shape of a face form reconfigurated using respectively the 4th principal 
component obtained on attribute addition conditions in the male face image. 

[Drawing 1 2] It is drawing showing the shape of a face form reconfigurated using respectively the 1st principal 
component obtained on attribute addition conditions in the female face image. 

[Drawing 13] It is drawing showing the shape of a face form reconfigurated using respectively the 2nd principal 
component obtained on attribute addition conditions in the female face image. 

[Draw ing 14] It is drawing showing the shape of a face form reconfigurated using respectively the 3rd principal 
component obtained on attribute addition conditions in the female face image. 

[Drawing 1 5] It is drawing showing the shape of a face form reconfigurated using respectively the 4th principal 
component obtained on attribute addition conditions in the female face image. 

[Drawing 1 6] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 

[Drawing 1 7] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 

[Drawing 18] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 

[Drawing 19] It is drawing showing the result of having compounded the face image with which age differs by 
mapping an age shape facility in an original face image. 
[Description of Notations] 
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